Estimating Ratios of Normalizing Constants for Densities with Diierent Dimensions Normalizing Constants with Diierent Dimensions
نویسنده
چکیده
In Bayesian inference, a Bayes factor is deened as the ratio of posterior odds versus prior odds where posterior odds is simply a ratio of the normalizing constants of two posterior densities. In many practical problems, the two posteriors have diierent dimensions. For such cases, the current Monte Carlo methods such as the bridge sampling method (Meng and Wong 1996), the path sampling method (Gelman and Meng 1994), and the ratio importance sampling method (Chen and Shao 1994) cannot directly be applied. In this article, we extend importance sampling, bridge sampling, and ratio importance sampling to problems of diierent dimensions. Then we nd global optimal importance sampling, bridge sampling, and ratio importance sampling in the sense of minimizing asymptotic relative mean-square errors of estimators. Implementation algorithms, which can asymptotically achieve the optimal simulation errors, are developed and two illustrative examples are also provided.
منابع مشابه
Estimating Ratios of Normalizing Constants Using Linked Importance Sampling
Abstract. Ratios of normalizing constants for two distributions are needed in both Bayesian statistics, where they are used to compare models, and in statistical physics, where they correspond to differences in free energy. Two approaches have long been used to estimate ratios of normalizing constants. The ‘simple importance sampling’ (SIS) or ‘free energy perturbation’ method uses a sample dra...
متن کاملEstimates and Standard Errors for Ratios of Normalizing Constants from Multiple Markov Chains via Regeneration.
In the classical biased sampling problem, we have k densities π1(·), …, πk (·), each known up to a normalizing constant, i.e. for l = 1, …, k, πl (·) = νl (·)/ml , where νl (·) is a known function and ml is an unknown constant. For each l, we have an iid sample from πl ,·and the problem is to estimate the ratios ml/ms for all l and all s. This problem arises frequently in several situations in ...
متن کاملSimulating Ratios of Normalizing Constants via a Simple Identity: a Theoretical Exploration
Let pi(w), i = 1, 2, be two densities with common support where each density is known up to a normalizing constant: pi(w) = qi(w)/ci. We have draws from each density (e.g., via Markov chain Monte Carlo), and we want to use these draws to simulate the ratio of the normalizing constants, c1/c2. Such a computational problem is often encountered in likelihood and Bayesian inference, and arises in f...
متن کاملStatistica Sinica 6(1996), 831-860 SIMULATING RATIOS OF NORMALIZING CONSTANTS VIA A SIMPLE IDENTITY: A THEORETICAL EXPLORATION
Let pi(w); i = 1; 2, be two densities with common support where each density is known up to a normalizing constant: pi(w) = qi(w)=ci. We have draws from each density (e.g., via Markov chain Monte Carlo), and we want to use these draws to simulate the ratio of the normalizing constants, c1=c2. Such a computational problem is often encountered in likelihood and Bayesian inference, and arises in e...
متن کاملPosterior Distributions on Normalizing Constants
This article describes a procedure for deening a posterior distribution on the value of a normalizing constant or ratio of normalizing constants using output from Monte Carlo simulation experiments. The resulting posterior distribution provides a simple diagnostic for assessing the adequacy of a simulation experiment for estimating these quantities, and is particularly useful in cases for which...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1997